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Abstract. On a spin manifold with conformal cusps, we prove under an invertibility 
condition at infinity that the eta function of the twisted Dirac operator has at most 
simple poles and is regular at the origin. For hyperbolic manifolds of finite volume, the 
eta function of the Dirac operator twisted by any homogeneous vector bundle is shown to 
be entire. 



1. Introduction 

The eta invariant was first introduced in [1] as a real number associated to certain elliptic 
first-order differential operators on compact manifolds with boundary, which happened to 
equal the difference between the Atiyah-Singer integral and the index with respect to 
the Atiyah-Patodi-Singer spectral boundary condition. During the thirty years since its 
discovery, this invariant has risen from the status of "error term" to that of a subtle tool, 
highly efficient in solving otherwise intractable problems from various fields of mathematics. 
Let us mention in this respect its recent application in finding obstructions for hyperbolic 
and flat 3-manifolds to bounding hyperbolic 4- manifolds [T7] . 

For a Hermitian vector bundle E over a closed manifold M, consider an elliptic self- 
adjoint first-order differential operator D : C°°(M, E) — > C°°(M, E). Then the L 2 spectrum 
of D is purely discrete and distributed according to the classical Weyl law. It follows that 
the complex function 

t,(D,s):= Yl A I A I" S " X 

A6Spcc(D)\{0} 

is well-defined (and holomorphic) when > dim(M). This function admits a mero- 
morphic extension to the complex plane with possible simple poles. If dim(M) is odd, the 
possible poles are located at dim(M) — 1 — 2N where N = {0, 1, 2, . . .}. If dim(M) is even 
and D is a Dirac operator associated to a Clifford connection, the eta function is entire [6]. 

It is a byproduct of the index theorem of Atiyah, Patodi and Singer that when M is a 
boundary and D is the tangential part of an elliptic operator as above, the point s = 
is always regular for the eta function. In fact, the eta function is always regular at the 
origin for general elliptic pseudodifferential operators; this was proved using i^-theory in 
the spirit of early index theory by Atiyah, Patodi, and Singer [3] in the odd-dimensional 
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case, and by Gilkey [9] for arbitrary dimensions. The eta invariant of D is denned as 



Still on a closed manifold another question arises: it is easy to note that the possible 
residue of the eta function at the origin is the integral on M of a well-defined density 
determined locally by D, called the local eta residue. Is this density zero? For arbitrary 
differential operators the answer is negative, but for Dirac operators it was proved by 
Bismut and Freed [2] that this is indeed the case. The proof uses the properties of the heat 
coefficients in terms of Clifford filtration, along the lines of Bismut's heat equation proof 
of the local index formula. 

In this note we first revisit the vanishing of the local eta density from the point of view 
of conformal invariance. We give a self-contained proof, using the APS formula, of the fact 
that the eta invariant of the spin Dirac operator is insensible to conformal changes. This 
important fact belongs to the mathematical folklore but we could not find a complete proof 
in the literature. The existing proofs (e.g. [21 pp. 420-421]) tend to use the index formula 
of pp for metrics which are not of product type near the boundary, without explaining why 
one can do so. In section [2] we show how to apply the APS formula to a true product- 
type metric in order to prove the conformal invariance of the eta invariant. We deduce 
the vanishing of the local eta residue from this conformal invariance, by interpreting the 
variation of the eta invariant in terms of the Wodzicki residue. 

Our main results concern the eta function on noncompact spin manifolds with conformal 
cusps, in particular on complete finite-volume hyperbolic spin manifolds. More precisely, 
let M be a compact manifold with boundary and [0, e) x DM a collar neighborhood of 
its boundary. The interior M° of M is called a conformally cusp manifold if it is endowed 
with a metric g p which near x = takes the form 



for some p > 0, where h is a metric on dM independent of x. The main examples are 
complete hyperbolic manifolds of finite volume, for which p = 1 and h is flat. Assume now 
that M is spin. Let E be a bundle with connection over M which is of product-type on 
the collar, and let D p denote the associated twisted Dirac operator on S ® E where £ is 
the spinor bundle over M. We assume that the spin structure and the connection on E 
are "nontrivial" (Assumption [1] in Section [5]) in the sense that the twisted Dirac operator 
D(dM,h) for the induced spin structure on (dM, h) is invertible. Under this assumption, 
the twisted Dirac operator D p is essentially self-adjoint with discrete spectrum obeying 
the Weyl law and the corresponding eta function n(D p , s) has a meromorphic extension 
to C with possible double poles [23]. For the untwisted Dirac operator on finite- volume 
hyperbolic manifolds, it was already noted by Bar [4] that the spectrum of D = D\ is 
discrete if and only if the spin structure is "nontrivial" on the cusps in the above sense, 
otherwise the continuous spectrum of D is 1R. In Appendix |A] we prove that the same 
occurs for conformal cusp metrics: If D^qm,K) fails to be invertible, then for p < 1 the 
twisted Dirac operator D p has essential spectrum equal to R. In the case p > 1, D p fails 



rj(D) = rj(D, 0) + dimker(D). 



(1) 
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to be essentially self-adjoint and although every self-adjoint extension of D p has discrete 
spectrum, nothing is known about the meromorphic properties of the corresponding eta 
functions. These are the reasons the "nontriviality" assumption plays an important role in 
this theory. The main results of this paper are that under Assumption [T] the eta function 
T)(D P , s) in fact has at most simple poles, and is always regular at the origin. Moreover, 
the poles disappear for hyperbolic manifolds, thus the eta function is entire in that case. 

Main Theorem. Let M° be an odd- dimensional spin manifold with conformal cusps, E 
a twisting bundle of product type on the cusps, and let D p be the associated twisted Dirac 
operator to ([!]) on £ ® E satisfying Assumption^ Then 

(1) The eta function rj(D p , s) of the twisted spin Dirac operator is regular for dt(s) > —2 
and has at most simple poles at s G {—2, —4, . . .}. 

(2) When p = 1, M° is hyperbolic of finite volume and E is a homogeneous vector 
bundle, the eta function r](D, s) of the twisted Dirac operator is entire. 

In even dimensions the eta function vanishes identically since the spectrum is symmetric, 
see Section [21 

A related question may be asked on more complicated metrics at infinity, like the fibered- 
cusp metrics arising on Q-rank one locally symmetric spaces. A similar problem arose 
from [18J, where we could obtain a meromorphic extension of the eta function for cofinite 
quotients of PSL^M) by using the Selberg trace formula. The methods employed here do 
not seem to extend easily to such spaces. 

We now outline this paper. We begin in Section [2] by proving that on a closed spin 
manifold the eta invariants are identical for two Dirac operators associated to conformal 
metrics. In Section [3] we review the Guillemin-Wodzicki residue density and residue trace 
and derive some of their elementary properties that we need in the sequel. In Section H] 
we give a new proof that on any spin manifold, the local eta residue of a twisted Dirac 
operator vanishes. In Sections [5] and [6] we prove the main theorem based on Melrose's cusp 
calculus [20] , which we review in Appendix [B] 

2. Conformal invariance of eta invariants on closed manifolds 

The eta invariant of the spin Dirac operator and of the odd signature operator are 
known to be invariant under conformal changes of the metric. Since on one hand we need 
to understand this fact in depth, and on the other hand we were unable to find a good 
reference, we chose to give here a complete proof. 

Let (M,g) be a closed spin Riemannian manifold of dimension n, (E, V) a Hermitian 
vector bundle on M with compatible connection V, and D the twisted Dirac operator. 
Note that when n is even, the eta invariant reduces to dimker(D) (which is known to be a 
conformal invariant, see (|5J)). Indeed, in even dimensions the operator D is odd with respect 
to the splitting in positive and negative spinors. Thus the eta function itself vanishes in 
these dimensions because the spectrum is symmetric around 0. For the untwisted spin 
Dirac operator, the same vanishing occurs in dimensions 4k + 1: for n = 8k + 1 the spinor 
bundle has a real structure (i.e. a skew-complex map C with C 2 = 1) which anti-commutes 
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with D, while in dimensions 8k + 5 it has a quaternionic structure (i.e. a skew-complex 
map J with J 2 = —1) which anti-commutes with D [U pp. 61, Remark (3)]. 

Let / G C°°(M) be a real conformal factor, g' := e~ 2 ^ g a metric conformal to g and D' 
the corresponding Dirac operator. 

Proposition 1. The eta invariants of D and D' coincide. 

Proof. The map of dilation by e* gives an SO(n)-isomorphism between the orthonormal 
frame bundles of g and g' . Thus the principal Spin(n)-bundle (for the fixed spin structure) 
corresponding to g and g' are also isomorphic via the lift of this map. This identifies the 
spinor bundles for the two metrics; the Dirac operators are linked by the formula 

(2) g' = e~ 2f g, D' = e^ f De^ f 

(see e.g. Proposition 1] for a proof). In particular, the null-spaces of these two operators 
have the same dimension. 

Let ip : I — [0, 1] — > R be a smooth function which is for t < 1/3 and which is 
identically 1 for t > 2/3. Set ft '■— ip(t)f and define a metric on X := / x M by 

h = dt 2 + e~ 2ft g. 

We denote again by E the pull back of E from the second factor, together with its connec- 
tion. Therefore, the curvature tensor of E on X satisfies 

(3) d t jR E = 0. 

The metric h is of product type near dX and hence the Atiyah-Patodi-Singer formula 
can be applied to the (chiral) twisted Dirac operator D + on X: 

index(D + ) = I A(R h )ch(R E ) - \r){D) + \r){D'). 
Jx 2 2 

On the other hand, this index is also equal to the spectral flow in the space of Riemannian 
metrics from D to D'; again by (J2J), there is no spectral flow so the index vanishes. The 
proof will be concluded by showing that the top component of the integrand in the APS 
formula vanishes. 

From ([3]) we deduce d t sexp(R E ) = so it is enough to show that d t -iA(R h ) = 0. Recall 
that A is a polynomial in the Pontrjagin forms ti{R h ) 2k G Q 4k (X). Also, recall that the 
Pontrjagin forms are conformal invariant (they only depend on the Weyl tensor - first 
proved by Chern and Simons [S]). Let 

h! = e 2ft h = e 2ft dt 2 + g. 

We claim that d t jti((R h ') 2k ) = for all k. Indeed, let V be the Levi-Civita connection of 
h! . For every vector field V on M denote by V its pull-back to X, which is orthogonal on 
the length- 1 vector field T := e~^d t . Note that 



[V,T] = -^(t)V(f)T, 



[V,U] = [V,U\. 
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We deduce that 

2(VyT, U) =V(T, U) + T(V, U) - U(V, T) 

+ ([V,T],U) + ([U, V],T) + ([U,T],V) 
=0. 

Clearly, since also (V V T,T) = 0, we infer V V T = 0. Directly from the definition of the 
curvature this implies that RyjjT = 0. If we split TX into TI © TM, we see from the 
symmetry of the curvature tensor that R%jj is a diagonal linear map, while R^ T is off- 
diagonal. It follows that dx-i(R h ') 2k is an off-diagonal form-valued endomorphism (since it 
contains exactly one curvature term involving T). Hence its trace is zero. □ 

Remark 2. The same proof applies as well to the (twisted) odd signature operator on any 
orientable manifold, since the Hirzebruch L-form, like the A-form, is also a polynomial in 
the Pontrjagin forms. 



3. The residue trace and the residue density 

We review a refined construction of the residue trace. Let A be a classical pseudodiffer- 
ential operator A of integer order on a smooth closed manifold M of dimension n, acting 
on the sections of a vector bundle E. We will later be interested in twisted spinor bun- 
dles over spin manifolds, but the description of the residue density does not need these 
assumptions. Let /^(m, m') be the Schwartz kernel of A, which is a distributional section 
in E M (E* £g) \Q\) over M x M with singular support contained in the diagonal. Choose a 
diffeomorphism 

(4) $ : U -> V C M x M, $(m, v) = (m, <p m (v)) 

from a neighborhood of the zero section in TM to a neighborhood of the diagonal in 
M, extending the canonical identification of M with the diagonal. Cut-off k,a away from 
the diagonal, i.e., multiply it by a function ip with support in V which is identically 1 
near the diagonal. Fix a connection in E, so that we can identify E^ with E^ using 
parallel transport along the curve t \— > <p m (tv). Then k,a) is a compactly-supported 
distributional section over TM in the bundle End(E) pulled back from the base, tensored 
with the fiberwise density bundle. This distribution is conormal to the zero section, thus 
by definition there exists a classical symbol a(m, £) on T*M (with values at (m, £) in 
End(E m )) such that 

Here uj is the canonical symplectic form on T*M, and f T * M / M means integration along 
the fibers of T*M. The result on the right-hand side is an End(£')-valued density in the 
base variables; however since the vertical tangent bundle to TM at (m, v ) is canonically 
isomorphic to T m M, this can be interpreted as a vertical density. 



m 
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Let "Ji be the radial (vertical) vector field in the fibers of T*M. Let ar_„i denote the 
component of homogeneity —n of the classical symbol a. Fix a Euclidean metric g in the 
vector bundle T*M (this amounts to choosing a Riemannian metric on M), thus defining 
a sphere bundle S*M inside T*M. 

Definition 3. The residue density of A is the smooth End(£')-valued density 

res(A) : = 1 A a[_ n ] ftjaA 
(27r) n Js*m/m 

At this stage, res(A) depends on a number of choices: the embedding $, the cut-off ip, 
the connection in E and the metric g. 

One way to show that res(^4) is defined independently of the choices involved is through 
holomorphic families. Let (t4 s ) s€ c be a holomorphic family of pseudodifferential operators 
on E such that A s is of order k — s, where k is the order of A, and A Q — A G ^>~°°(M, E). 
Then for 3?(s) sufficiently large, restricting the Schwartz kernel of A s to the diagonal A 
gives a well-defined and holomorphic End (E) -valued density 

F(s) := k As \ a . 

This density extends to C with possible simple poles at s 6 n + fc-N, where k is the order 
of A and N = {0, 1, 2, 3, . . .}. One natural choice of a holomorphic family is A s = AQ S 
or A s = Q S A where {Q s )sec is a holomorphic family of pseudodifferential operators on E 
such that Q s is of order — s and Qo — Id G \E'~ 00 (M, E). It is then straightforward to check 
that 

(5) Res s=0 F(s) = res(A). 

Thus, the residue Res s= o-F(s) is well-defined irrespective of the choice of A s , and also res(y4) 
is well-defined independently of choices. The residue trace of A is defined by 

(6) Tr R (A) = Res s=0 Tr(A s ) = [ tr(res(A)). 

J M 

Armed with this holomorphic family interpretation of res(A) and Tr^A), one can deduce 
without effort various properties of res and Tr#. For example, it follows that Tr# vanishes 
on commutators. Indeed, given integer order operators A and B and taking any auxiliary 
family Q s as explained above, we can write 

Tr(L4, B]Q 8 ) = Tr(C s ) + Tr(L4Q s , B]), 

where C s = ABQ S — AQ S B is a holomorphic family of operators that is smoothing at 
s = 0. One can check that Tr[S, T] = for any pseudodifferential operators S and T 
with ord(S') +ord(T) < —n, so for 5ft(s) sufficiently large, the trace Tr([AQ s , B}) vanishes. 
Therefore, by analytic continuation, Tr([AQ s ,B]) vanishes for all s G C; in particular, we 
have Tr(L4, B]Q S ) = Tr(C s ). Now Co is smoothing, and since the residue density of a 
smoothing operator is zero, we have Res s= oTr(C s ) = TrR(Co) = 0. Thus, Tr^([A, B]) = 0. 
Furthermore, if S is any section in End(E), using the fact that 

ksa s = Sk As and k AsS = k As S, 
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where A s is a holomorphic family as in the formula (jSJ), we have res^-A) = S'res(A) and 
res(AS') = res(y4)S'. That res(SVl) = Sres(A) also follows directly from Definition [3J In 
particular, we have 

(7) res(wA) = res(Au) = wres(A) 

for every function u £ C°°(M, C). Finally, observing that 



ka s \a — [Ka* s \A 

taking the residue at s = of both sides we obtain res(A) = res(A*)*; that is, we have 
res(A*) = res(A)*. 

4. Vanishing of the local eta residue 

Let (D t ) t( zj be a smooth 1-parameter family of elliptic self-adjoint pseudodifferential 
operators of order 1 on a closed manifold M. For simplicity assume for a moment that D Q 
is invertible, hence D t is invertible for small enough t. Then 



d t r){D t ,s) =d{Ti [D t {D 2 t y s -^ 



=Tr (A(AT^) - ^Tr ( Dt (D^(D t D t + D t D t 
---sTr [b t {D 2 t )~^ 



= - sTi [b t \D t \-\Di 

Now Q s := (-Dj) - ^ is an analytic family of operators of order — s and Qo = Id, therefore 

(8) d tV (D t ) = \-sTr ( D t \D t \- l Q s )} = -Tr fl (A|A| _1 ). 

From ([6]), the Wodzicki residue trace vanishes on smoothing operators, so as a corollary we 
see that the eta invariant is constant under smoothing perturbations. By this argument, 
the above expression makes sense even when D t is not invertible. 

In the same spirit, let D be an elliptic self-adjoint invertible pseudodifferential operator 
of order k £ (0, oo). Then the residue at s = of the eta function r](D, s) is 

Res s=0 Tr( J D| J D|- 1 ( J D 2 )-f) = ^Tt R (D\D\~ l ) = \ I tr(res(-D|-D| -1 )). 

fc ft J M 

We have been assuming that M is closed, so that the trace on the left is defined. However, 
notice that by definition, tr(res(D|i5|~ 1 )) is a local quantity in the sense that it depends 
only on finitely many terms of the local symbol of D\D\~ l \ moreover, each homogeneous 
term of D\D\~ l is given by a universal formula in terms of the local symbol of D in any 
coordinate patch. Using this universal formula for the — n degree homogeneous term allows 
us to define the local eta residue on the interior of any manifold (with or without boundary, 
compact or not), even in the case that |-D| _1 does not exist. 
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Definition 4. Let M be a possibly non-compact manifold, E — > M a vector bundle and 
zGC. For any elliptic pseudodifferential operator D e \f /2 (M, the density 

tr(res(D|-D| _1 )) G |fi(M)|. 

is called the local eta residue of D. 

From the definition of the residue density, the local eta residue is constant under smooth- 
ing perturbations, so the definition makes sense when D is not invertible, non symmetric. 
The local eta residue can be non-vanishing in general (when M is compact, its integral 
always vanishes for self-adjoint operators of positive order since the eta function is regular 
at s = [9]). However, for Dirac operators we have: 

Theorem 5. [5] Let (M, g) be a spin Riemannian manifold and E a twisting bundle. Then 
the local eta residue tr{ves{D\D\~ 1 )) of the twisted Dirac operator vanishes. 

Proof. We give here a new, easy proof. Assume that M is closed; this theorem is a local 
question, so this case suffices. Let / be an arbitrary smooth real function on M. Define D t 
as the Dirac operator associated to the family of conformal metrics e~ 2t ^ g. This operator 
is an unbounded operator in the L 2 space associated to the measure e~ nt ^ g . To work in 
the fixed Hilbert space L 2 (fi g ), conjugate through the unitary transformation 



L 2 (M, £ ® E, e~ ntf fig) -> L 2 (M, S ® i-> e 

where E denotes the spinor bundle over M. Using (J2J), D t conjugates to 

D t =e^De^ acting in L 2 (M, S <g> E, fi g ) 

and we compute 

(9) d t b t = l -(fD t + b t f). 

Using Proposition [1] we have on one hand 

d tV (D t ) = d tV (D t ) = 0. 
On the other hand, plugging <M} at t — into (jSJ) we write: 



ntf 



-dtv{D t )\t=o =Tr 



l -(fD + Df)\D\- 1 



since Dn = D 



---lk R (}D\D\- 1 + f\D\^D) since Ty r is a trace 
=Tr/j(/D|D| _1 ) since D commutes with \D\ 



[ triresifDlDl- 1 )). 

J M 



From the definition (see also ((Tj)), ves{fD\D\ x ) = fres(D\D\ x ). Since / was arbitrary, 
we deduce tr(res(_D|.D| _1 )) = as claimed. 

□ 
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We will need such a vanishing result for a larger class of first-order symmetric differential 
operators: 

Corollary 6. Let D be a twisted Dirac operator on a spin manifold (M,g). For any 
u G C°°(M, R), the operator D u := e~ u De u is symmetric on M with respect to the measure 
fi u := e 2u fi g , and the local eta residue of D u vanishes. 

Proof. It is clear that D u is formally self-adjoint with respect to the measure fi u . As in 
the proof of Theorem to prove that the local eta residue of D u vanishes we can assume 
that M is compact. Then \D U \ = e~ u \D\e u , hence D^DJ^ 1 = e' u D\D\- l e u . By 
res(D u \D u \~ l ) = res(e _ '"-D|-D| _1 e") = res(i5|£)| _1 ). The trace of this last endomorphism- 
valued density vanishes by Theorem □ 



We turn now to our main object of study. 

Let M° be the interior of a compact manifold with boundary M of dimension n. We 
assume that M is spin with a fixed spin structure, and that the metric is of conformally 
cusp type as in [23] . To explain this notion, let x : M — > [0, oo) be a boundary-defining 
function for the smooth structure of M, namely 



(3) The 1-form dx is non-vanishing on DM. 
There exists a neighbourhood U C M of dM and a diffeomorphism $[/ : U — > [0, e) x dM 
such that x\u is the composition of &u with the projection on the first factor. In the sequel 
we fix such a product decomposition near the boundary. 

The metric g on M° is said to be of conformally cusp type if on U D M° it is of the form 



where p G (0, oo) and h is a metric on dM which does not depend on x. Thus g p = x 2p g c , 
where g c is a particular case of an exact cusp metric as in [201 [23] and also an exact 6-metric 
in the sense of Melrose. Geometrically, g c , which takes the form g c = +h on Un M°, is 
simply a metric with infinite cylindrical ends, as one can see by switching to the variable 
v = 1/x. Recall that x is a global function, thus g p is defined on M°. The motivating 
example is given by complete hyperbolic manifolds of finite volume. Outside a compact 
set, such a hyperbolic manifold is isometric to an infinite cylinder (1, oo) x T where (T, h) 
is a (possibly disconnected) flat manifold; the metric takes the form 



which is easily seen to be of the form (imp with p — 1 if we set x := e~ l . 

Let E be a twisting bundle on M, with a connection which is flat in the direction of d x . 
This implies that near the boundary, E together with its connection are pull-backs of their 
restrictions to the boundary E\qm- Finally, let D p (where 2p is the power in the conformal 
metric g p ) denote the twisted Dirac operator associated to the aforementioned data. 



5. Eta function on conformally cusp manifolds 



(1) x G e°°(M); 

(2) {x = 0} = dM; 



(10) 




dt 2 + e~ 2t h 
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The main assumption under which we work is the invertibility of the boundary Dirac 
operator. More precisely, 

Assumption 1. For each connected component N of dM, we assume that the Dirac op- 
erator D(QM,h) on N with respect to the metric h and twisted by E, is invertible. 

Under this assumption, the results of [23] imply that the L? spectrum of the essentially 
self adjoint operator D p is discrete and obeys a Weyl-type law; moreover the eta function 
r](D p , s) is holomorphic for 3?(s) > n and extends to a meromorphic function with possible 
double poles at certain points. In particular, for n odd, s = is such a possible double 
pole. 

Theorem 7. Under Assumption^ the eta function of the twisted Dirac operator on M° 
is regular at s = 0. 

It follows that we can define a "honest" eta invariant, depending on the eigenvalues of 
D p , as the regular value at s = of r](D p , s). 

Proof. We need to revisit the construction giving the meromorphic extension and the struc- 
ture of the poles of the eta function. The main tool is the calculus of cusp pseudodifferential 
operators first introduced in [20] , whose definition we review in Appendix [B] 

The spinor bundles for conformal metrics are canonically identified together with their 
metrics. It follows that D c , the Dirac operator for g c , is linked to D p by formula §2§. 
However these two operators act on different L 2 spaces because the measures fi p and /i c 
induced by the metrics g p , g c are not the same. We view D p as acting in L 2 [M° , E ® E, fj, p ) 
and we conjugate it through the Hilbert space isometry 

L 2 (M°, E <8> E, Hp) -> L 2 (M°, E <g> E,[i c ), a i-> x np/2 a. 

It follows that Dp is unitarily equivalent to the operator 

np np n . . 

A = x~D p x~~ acting in L 2 (M°, E ® E, /i c ). 
Using the formula (T2J) with e~^ = x p , we see that 

D p = x- pS ¥D c x p ^. 

In the sequel we thus replace D p by the unitarily equivalent operator 

A = x~^D c x~^- acting in L 2 (M°, E <g> E, /i c ). 

This operator is an elliptic operator in the weighted cusp calculus £- p Dift^(M,E ® E). 
The normal operator of a cusp operator P in Diff^(M, E®£) is the 1-parameter family of 
operators on dM defined by 



K(P)(O0= [e l ~P(e 



\\x=0 



for (el, where is any extension of the spinor from dM to M. 

Since g c and the twisting bundle E and its connection are products near infinity, we have 



;il) D c = c[v)x 2 d x + D (dM , h) , A = x~ p [(x 2 d x - ^) c{v) + D 



'(dM,h) 
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where D^qm,K) is the Dirac operator on dM, v = and c(u) is Clifford multiplication by 
v. It follows from the definition that 

(12) N(D c )(0 = c(v)t£ + D {dM , h) . 

The boundary operator DiQ Mth \ anti-commutes with c{v) for algebraic reasons and is in- 
vertible by Assumption [TJ Since 

X(D c )(0 2 = ? + Df 9M>h) 

is strictly positive, it follows that 3N~(-D C )(£) is invertible for all £. Such an operator is called 
fully elliptic. From [23], we know that A has essentially the same properties as an elliptic 
operator on a closed manifold: it is Fredholm, has compact resolvent and (in the self-adjoint 
case) has pure-point spectrum. The eigenvalues are distributed according to a suitable 
Weyl-type law; in particular, the eta function rj(A, s) is well-defined for large real parts of 
s. Moreover, A{A 2 )~^~ is a holomorphic family of cusp operators in x ps ^~ s (M, E cg> E) 
if we define it to be on the finite-dimensional null-space of A, see [23] Proposition 15]. 
It follows from [23| Proposition 14] that the trace of this family (i.e., the eta function) 
extends meromorphically to C with possible poles when s G {n, n — 1, n — 2, . . .} and when 
ps G {1, 0, — 1, —2 . . .}; the poles are at most double at points in the intersections of these 
two sets, otherwise they are at most simple. The content of the theorem is that s = is 
in fact a regular point. We will see later that some of the above singularities do not occur 
in our setting. 

To start the proof, consider the holomorphic family in two complex variables 

(13) (s, w) i-> x w A(s), A{s) = x- ps A{A 2 )-^ G V~ S (M, E <8> E) 
and the function 

F(s,w) := Tr(x w A(s)). 

Clearly F(s,ps) = r}(D p , s). 

Lemma 8. The operator x w A(s) is of trace-class for dt(s) > n,3t,(w) > 1. Moreover, 
F(s, w) is holomorphic for 3?(s) > n, dt(w) > 1 and extends to C x C as a meromorphic 
function with possibly simple poles in s at s G {n,n — l,n — 2, . . .} and in w at w G 
{1,0,-1,-2,...}. 

Proof. The operator kernel of x w A(s) is smooth outside the diagonal and continuous at 
the diagonal for 3?(s) > n. Its restriction to the diagonal is a smooth multiple of the cusp 
volume density for such s, and has an asymptotic expansion in powers of x as x — > 0, 
starting from x w . This is due to the fact that A(s) is a conormal distribution on the cusp 
double space M 2 , with Taylor expansion at the front face. 

The trace of x w A(s) equals the integral on the lifted diagonal of the above density. The 
normal bundle to A c in M 2 is canonically identified with C TM. By the Fourier inversion 
formula, this is equal to 

(14) f x w a s {p^)u n 

J C T*M 
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where a s (p, £) is a holomorphic family of classical symbols of order — s on C T*M (smooth 
down to x — 0) and u is the canonical symplectic form on C T*M. The volume form u n is 
singular at M, however x 2 times it extends smoothly to the boundary of C T*M. It follows 
that the integral is absolutely convergent (hence holomorphic in s, w) for 9?(s) > n, 3l(w) > 
1. 

It is now easy to construct the analytic extension of (fill) in w by expanding a s (p,£) in 
Taylor series at x = 0, using that for any k £ N, we have 

1 ^ _ 1 



o 



To get the analytic extension of (I14p in s we expand a s (p, £) in homogeneous components 
in £ of order —s — k where fc £ N, then switching to polar coordinates and using that 

i 

r~ s ~ k+n - l dr = -. 



s — n + k 

□ 

We first note that there is no pole at s = 0. From here on, we assume that the dimension 
of the manifold M is odd, otherwise the eta function is so there is nothing to prove. 

Proposition 9. The function F(s,w) is regular in s at s = 0. 

Proof. From the construction of the analytic extension of F it follows that for every w with 
$t(w) > 1, 



Res s=0 F(s,w) = [ x w tr(res(A\A\~ 1 )). 



As A is unitarily conjugated to D p by a real function, we see from Corollary [6] that the 
density tr(res(v4|y4| -1 )) vanishes identically. In other words, the holomorphic function 
w i — > Kes s= oF(s, w) is identically on a half-plane, and by unique continuation it is 
identically zero for all w. □ 

It remains to show that there is no pole in w at w = either. This will imply Theorem 
[7] since rj(D p , s) = F(s,ps). 

For this, we fix s with dt(s) > n and we examine F(s, w) as a meromorphic function in 
the complex variable w. 

For any cusp operator B £ x z ^~ s (M) (where we suppress the bundles for brevity) 
consider the power series expansion of its Schwartz kernel x~ z kb at the front face of the 
cusp double space. Although x is not everywhere a defining function for the front face, we 
do get such an expansion since Kb vanishes in Taylor series at faces other than the front 
face. Taking the inverse Fourier transform of the coefficients we can regard the coefficients 
as lying in the suspended calculus *&~^(dM). This gives a short exact sequence of spaces 
of operators 

(15) ^ x°°^- s (M) x z y~ s (M) S x z ^{dM)[[x]] -> 0. 
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For a weighted cusp operator B £ x z ^~ s (M), we write 

q{B) = x z (q (B) + xq x {B) + x 2 q 2 {B) + . . .) 

It is easy to see that we have qo(B) = r N(x~ z B) ) see [20] . 

We use a result from [T3]. Let s > n and P £ ty~ s (M) with 9ft(s) > n. Then x w P is 
trace-class for w > 1, and for fc £ N, 

(16) Res w=1 _ fc Tr(^P) = -L / Tr( ?fe (P)(£))cZ£. 

Proposition 10. T7ie function F(s, w) does not have any poles in w. 

Proof. Let R £ Diff*(M, £ ® P) be any cusp differential operator which equals Dg := 
c{v)D(QM,h) near the boundary. This makes sense since we have a fixed product decompo- 
sition near the boundary. By definition we have 

q(R) = D d . 

We notice that near dM, Dq anticommutes with the cusp differential operator A from (11 II) . 
Therefore, if we denote by 3 s := ker(g) C fy s c (M, S (g) E) the subspace of operators which 
vanish to every order at the front face, we have 

RA + ARe J 2 . 

This implies 

[R,A 2 }e'J 3 , [R,(A 2 )-^]eT s ; 

the latter, by the construction of the complex powers [7]. Together with the obvious 
commutation [R, x~ ps ] £ J°, we get for the operator A(s) defined in (fl3l) 

RA(s) + A(s)R £ r s . 

Now for every cusp operator Q we have 

q(RQ) = D d q(Q), q(QR)=q(Q)D 9 

because R is constant in x near the boundary. Therefore Dgq(A(s)) = —q(A(s))Dg. Using 
conjugation with the invertible operator Dq on dM, we see that for every £, 

Tr (q(A(s))(0) = Tr (D B q(A(s))(QDj ') = -Tr (q(A(s))(Z)D B Dg ') 

so Tr (g(y4(s))(£)) = 0. Thus for all k £ N the integrand in (1TB]) for P = A(s) vanishes. □ 

Together with Proposition this finishes the proof of Theorem [7] since fj(D p , s) = 
F(s,ps). □ 

In fact, by invoking the regularity results of Bismut and Freed j5], we can restrict further 
the possible poles of the eta function. By a different argument, it turns out that if M° 
is a hyperbolic manifold, then there are no poles at all (see Theorem [12]) ! Of course, we 
assume that n is odd since otherwise the eta function is 0. 

Theorem 11. Under Assumption^ the eta function t](D p , s) is regular for dt(s) > —2 
and has at most simple poles at s £ {—2, —4, . . .}. 
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Proof. We have written rj(D p , s) = F(s,ps) for an analytic function F(s, w) in w G C, s G 
C \ {n, n — 1, . . . , 1, — 1, — 2, —3, . . .} by Theorem Lemma [HI and Proposition [TUJ We 
claim that F(s,w) is in fact regular at s G C \ {—2, —4, . . .}. Indeed, for 9ft (w) > 1 the 
residue in s at s = n — k is given by 

x UJ - p(n - fc) tr(res(A|A| fc - n - 1 )). 

Since A = x^D p x r, we have AIA^ - ™" 1 = x^D p |D p | fc ~' 1 ~ 1 a; a : so by ([7]), 

Res s=n _ fc F( S , W )= / x"'-^- fc )tr(res( J D p | J D p | fc ^- 1 )). 

J M 

Consider the well-known odd heat kernel small-time expansion given in Lemma 1.9.1 of 

ma 

oo 

(17) D p e~ tD Hy,y)^J2t^ 1 b k (y) 

k=0 

valid on the interior of any manifold, by locality of the coefficients; moreover, for k even, 
we have b k = 0. From the relationship 



1 



D P \D P \- 8 - 1 = _ t^-tx / t^D n e- tD idt 



r(f) 



■ n—k+1 



we deduce that 

(19) res( J D p | J D p | fc -"- 1 ) = 

In particular, when k is even, this residue vanishes. By the regularity results of Bismut- 
Freed [5], the pointwise traces of the local coefficients bo, b±, . . . , b n vanish identically, i.e. 
tx(bk(y)) = for k = 0, . . . , n so for these k the density tr(res(Dp|Dp| fe ~™ _1 )) also vanishes. 
(The vanishing of the term with k = n, corresponding to the residue of the eta function 
at the origin, has already been proved in Proposition [9] by using conformal invariance, 
although here we could have also deduced this fact from the regularity results of Bismut- 
Freed [5].) This proves that F(s, w) is regular at s G C \ {—2, —4, . . .}. □ 

In the hyperbolic case we have a stronger result. The necessary local vanishing of the 
heat trace is proved in the next section. 

Theorem 12. If M° is an odd dimensional hyperbolic manifold of finite volume, the eta 
function of the Dirac operator twisted by a homogeneous vector bundle is entire. 

Proof. By Proposition [TBI in Section Ei we have that for m G HP(IR) with n — 2d+ 1, 

ti(De~ tD \m,m)) = 0. 

This implies that tr(6^) = for all the coefficients bf. on IEP(IR), and thus also on the 
locally symmetric space M°. In view of (I19j) . the possible poles in s of the function F(s, w) 
actually do not occur. Together with Proposition [TU], this shows that the eta function is 
entire since rj(D, s) = F(s, s). □ 
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6. Odd heat kernels for homogeneous vector bundles over hyperbolic 

SPACE 

The real hyperbolic space HI n (IR) is given as the symmetric space SO(n, l)/SO(n). But, 
for our purpose, we use the realization of HP(IR) = G/K where G = Spin(n, 1), K = 
Spin(n), which are the double covering groups of SO(n, 1), SO(n). We denote the Lie 
algebras of G and K by g and 6, respectively. The Cartan involution 9 on g gives the 
decomposition g = 6 © p where 6 and p are, respectively, the +1 and —1 eigenspaces of 9. 
The subspace p can be identified with the tangent space T {G/K) = g/t at o = eK G G/K. 
Let a be a fixed maximal abelian subspace of p. Then the dimension of a is one. Let 
M = Spin(n — 1) be the centralizer of A = exp(a) in K with Lie algebra m. We put (3 to 
be the positive restricted root of (g, a). Note that A = R via a r = exp(rif) with H G a, 
P(H) = 1. 

From now on we assume that n is odd, that is, n = 2d+ 1. 

The spinor bundle E over HP(R) = G/K = Spin(n, 1)/Spin(n) is defined by 

(20) £ = Spin(n, 1) x Ts V Ts — ► U n (R) = Spin(n, 1)/Spin(n) 

where (r s , V Ts ) denotes the spin representation of Spin(n). Here points of Spin(ra, 1) x Ts V Ts 
are given by equivalence classes [g, v] of pairs (g, v) under (gk, v) ~ (g, r s {k)v). In general, 
any G-homogeneous Clifford module bundle over HP(IR) is associated to (r s ® r, V Tg <S> V T ) 
for a unitary representation (r, V T ) of Spin(ra) as in (]20p . which we denote by E ® E. For 
instance, the representation t s ® t s of Spin(n) determines a homogeneous vector bundle 
E <g> E over U n (R) whose fiber is V Ts ® V Ts = ® d k=0 A k (p ® C). 

The space of smooth sections from HP (R) to E®E is denoted by e°°(e n (]R), E® and 
can be identified with [Q°°(G) ® V^- s ® K-]^ where K acts on C°°(G7) by the right regular 
representation R. Now a natural connection V : e°°(e n (IR), E ®E) -> C 00 (H n (R) , E ® E ® 
T*{G/K)) is given by 

n 

(21) V/ = ^( J R(X i )®Id)/®X* 

i=l 

where {Xj} is an orthonormal basis of p and {X*} is its dual basis. This connection is 
the unique connection on C°°(E £g) E) which is G- homogeneous and anti-commutes with 
the Cartan involution 9 (see Lemma 3.2 of [21]). Now the Dirac operator D on E <g> E 
associated to the connection V is defined by 

n 

D = ^R(X i )®c(X i ) 

i=l 

where c(Xj) denotes the Clifford multiplication. 

Proposition 13. Form G HP(IR), we have ti{De~ tr>2 {m, m)) = 0. 

Proof. Recalling e°°(e n (M), E ® E) = [G°°(G) ® V Ts ® V T ] K , the Schwartz kernel of De~ w2 
is given by a section ff t in [e oo (G) ® End(K s ® K)] KxA " satisfying 

(22) H t (k ig k 2 ) = (t s ® r)- 1 {k 2 )H t {g){r s ® r^h)' 1 
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for fci, k 2 G K, g G G, which acts on [C°°(G) (g> K s <E> K-] by convolution. For each t > 0, H t 
lies in [8(G) ® End(V T , ® where 8(G) = n p>0 S p (G) with S P (G) the Harish- Chandra 

L p -Schwartz space. For more details, we refer to Section 3 of [21] . Taking the local trace 
of f/t, we have that h t := tr(H t ) G 8(G). From ( 122]) and recalling that a point in the 
homogeneous vector bundle £ ® is given by an equivalence class through the relation 
(^fc, ~ (g, {T s ®T)(k)v), we can see that the local trace of De~ tD (m, m) is given by h t (e) 
for the identity element e G G. 

By the Plancherel theorem (see Theorem 4.1 in [22]), we have the following expression 
for h t at e G G (up to a constant depending on a normalization), 

/oo 
e CT , iA (Mp(^A)dA, 
-oo 

o-eM 

where M denotes the set of equivalence classes of irreducible unitary representations of M, 

B a ,a(h t )=Tr h t (g)ir atiX (g) dg, 
Jg 

and p(a, iX) denotes the Plancherel measure associated to the unitary principal represen- 
tation ir^ix- Here the unitary principal representation 7r CTj j A = lnd MAN (a ® e lX ® Id) acts 
by the left regular representation on 

H a , lX = { f : G ^ V a | f(gma r n) = e^ iX+d ^ H a{ m y l f{g) } 
where n — 2d+ 1. By Proposition 3.6 in [24J, it follows that 
(24) Qa,ix(ht) = [(r s ® t)\ m : a]([a : (7+] - [a : Ae" 4 " 2 

where a± denotes the half spin representation of M such that t s \m = cr+ © By the 
branching rule from K = Spin(2d+ 1) to M = Spin(2c/) given in Theorem 8.1.3 of [13], we 
have that for any r G K, a G M, [t|m : cr] < 1 and [t|m : a] = 1 if and only if 

a, - 6, G Z = 1,2, ...,d), ai > 6i > . . . a d _i > b d ^ > a d > \b d \ 

where r = J2i=i a i e i> a = Y^t=i ^ e «- H ere we denote the highest weights of the representa- 
tions r, a with respect to the standard basis. This implies that 

[(t 8 ®t)\ m :a][a: a + ] = [(t s ®t)| m : a+] = [(t s ®t)\ m ■ a~] 

= [{t 8 ® t)\ m ■■(?}[(?: cr_] 

since a± = |(ei + e 2 + . . . + e d -\ ± e d ). Now, by Theorem 3.1 of [21], we also have 
p(a + ,i\) = p(cr_,zA). This implies h t (e) = by (123!) and (|24j) . which completes the 
proof. □ 

Remark 14. It can be proved, using the Selberg trace formula, that the eta function vanishes 
at negative odd integers under the condition r PI P = T H N for the fundamental group 
T of the given hyperbolic manifold where P = MAN (Langlands decomposition) denotes 
a parabolic subgroup of G fixing the infinity point of a cusp. Recall that this fact is true 
for arbitrary operators of Dirac type over closed manifolds, as follows immediately from 
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(]18p and from the odd heat trace expansion ffTTj) . We believe that this vanishing holds also 
in the context of manifolds with conformal cusps without this technical condition but the 
necessary work, which surpasses the scope of this paper, is left for a future publication. 

Appendix A. The spectrum of the Dirac operator 

Recall that under Assumption [I], the Dirac operator D p is always essentially self-adjoint 
with discrete spectrum [23]. One may ask what happens with the eta invariant when 
Assumption [T] does not hold. Like in [I], for p < 1 when the manifold is complete with 
respect to g p , the answer is that the continuous spectrum of the twisted Dirac operator 
(which is essentially self adjoint by [28], [27]) becomes the full real line, hence the usual 
definition of the eta invariant breaks down. We will not attempt here to extend the 
definition in that case, note however that for finite-volume hyperbolic manifolds this has 
been done in [26]. The proof of the following result is very similar to the corresponding 
statements from [TTJ [12] concerning magnetic and Hodge Laplacians. 

Theorem 15. Let M be a spin manifold with conformal cusps and E a twisting bundle of 
product type near the cusps. Let D p denote the Dirac operator associated to the metric (CQ) 
on M, twisted by E. If Assumption^ does not hold, then 

• ifO<p<l, the essential spectrum of D p is M. 

• if p > 1, then D p is not essentially self-adjoint, and every self-adjoint extension of 
D p in L 2 has purely discrete spectrum. 

Proof. The idea is to reduce the problem to a 1-dimensional problem, essentially to the 
computation of the spectrum of idt on an interval. 

When p > 1, the metric is of metric horn type, and self-adjoint extensions of D p on M 
(given by boundary conditions at x = 0) are in 1-to-l correspondence with Lagrangian 
subspace in ker (D(g M ^) with respect to the symplectic form 

see [16]. Such subspaces exist by the cobordism invariance of the index (note that dM 
may be disconnected). Moreover, since Assumption [1] does not hold, there exist infinitely 
many Lagrangian subspaces in ker(D(g Mjh }) thus D p is not essentially self-adjoint. 

We work with the operator A from (ITT]) , which is unitarily conjugated to D p hence has 
the same spectrum as D p . When p > 1, for each Lagrangian subspace W C ker(D(Q Mth )), 
A is essentially self-adjoint on the initial domain 

D W (A) = e^(M, £ ® E) © {<f){x)x p/2 w; w eW} 

for some fixed cut-off function supported in the cusps which equals 1 near infinity. When 
< p < 1, A is essentially self-adjoint on T>(A) = e~(M, £ ® E). 

The essential spectrum of A (with the above boundary condition when p > 1) can be 
computed on the complement of any compact set in M, i.e., on the union of the cusps, 
by imposing self-adjoint boundary conditions. More precisely, consider the non-compact 
manifold with boundary M e := {x < e}. We need to specify a self-adjoint boundary 
condition for A at x = e, which is obtained by the APS condition and by choosing yet 
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another Lagrangian subspace in ker(D^g M ^). With these self-adjoint boundary conditions, 
the decomposition principle (see [U Prop. 1]) states that the essential spectrum of A on 
M e coincides with the essential spectrum of A on M. 

We decompose the space of L 2 spinors on DM twisted by E into the space of zero-modes 
(i.e., the kernel of D^QM,h)) and its orthogonal complement consisting of "high energy 
modes". Accordingly we get an orthogonal decomposition of L 2 (M e ,£ Cg> E) into zero- 
modes and high energy modes, the main point being that A preserves this decomposition. 
As in [T21 Prop. 5.1] the high energy modes do not contribute to the essential spectrum. 
The reason is that there exists a cusp pseudodifferential operator R £ x _2p ^/~°°(M, H®E), 
localized on the cusps and acting as on high energy modes, such that A 2 + R is fully 
elliptic. Therefore this operator has discrete spectrum so in particular, on high energy 
modes A 2 has discrete spectrum as claimed. We are left with the formally self-adjoint 
operator 

A := x 1 ^) (xd x - §) 

acting in L 2 (0, e)(g)ker(D(a A f,/i)) with respect to the volume form (with a certain boundary 
condition at x — e). 

We claim that Aq is unitarily equivalent to c{v)tdt over a certain interval depending on 
e and p, with respect to the measure y. We start by conjugating with x 1 / 2 , so the volume 
form becomes — and 

X 

x~^A x^ = x 2 ~ p c(v)d x + ~ p)x 1 ~ p . 

For p — 1, we already obtain the desired expression for our operator by setting t := x. For 
p ^ 1, we write 

x 2 ~ p d x = y 2 d y , y:=(l-p)x l ~ p . 

Then, after conjugating with y^ 1 ^ 2 , we obtain the operator c(u)y 2 d y acting in L 2 with 
respect to the measure With the change of variable cusp-to-b 

t := e~ l 'y 

we get the desired operator. 

Now for p < 1 the operator c(u)tdt acts on an interval of the form (0, /3), while for p > 1 
it acts on for some strictly positive (3. Here c(u) is a diagonalizable automorphism 

with ±z eigenvalues. For every self-adjoint extension, in the first case the spectrum is IR 
while in the second case it is discrete. □ 

Alternatively, one could prove the first part of the theorem similarly to [1] by constructing 
Weyl sequences for each real number. 

Although for p > 1 the spectrum of any self-adjoint extension of D p is discrete even 
when Assumption [1] does not hold, the methods of this paper do not show the meromorphic 
extension of the eta function in that case. 
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X = (l,oo) t x N 
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M = [0, 1), x N 




cylindrical end 



compactify 



x = 1/t 



t = 1/x 



Figure 1 . Compactifying X into M. 



Appendix B. Elements of the cusp calculus 



In this appendix we give a short introduction to the cusp calculus (first defined by 
Melrose and Nistor [20J). Consider a Riemannian manifold X with a cylindrical end as 
shown in the left-hand side of Figure [TJ The metric takes the form dt 2 + h on the cylinder 
where h is a metric on the cross section N. Changing coordinates to x — 1/t and noting 
that for t G (1, oo) we have x G (0,1), and t — > oo implies x — > 0, it follows that we 
can view X as the interior of the compact manifold M obtained from X by replacing the 
infinite cylinder (1, oo) t x N with the finite cylinder [0, l) x x N, see Figured! 

A cusp pseudodifferential operator is just a "usual" pseudodifferential operator on X 
that "behaves nicely" near t — oo. To make this precise, recall that in local coordinates 
on the cylinder, the Schwartz kernel of an m-th order (m G C) pseudodifferential operator 
A on X takes the form 



where (t, t', y, y') G (1, oo) 2 x U 2 with IX local coordinates on iV and a is a classical symbol 
of order m in r and 77. We say that the operator A is, by definition, an m-th order cusp 
pseudodifferential operator if in the compactified coordinates, 



is smooth at x = (and is still classical in r and 77). This definition only works on the 
cylinder, so to be more precise, A is a cusp operator if it can be written as A\ + A2 + A3, 
where A\ is of the form (1251) such that a(x,y,T,rj) := a(l/x,y,T,rj) is smooth at x — 0, 
A2 is a usual pseudodifferential operator on the compact part of X, and finally, where A3 
is a smoothing operator on X that vanishes, with all derivatives, at 00 on the cylinder (or 
equivalently, the Schwartz kernel of A 3 is a smooth function on M 2 vanishing to infinite 
order at d(M 2 )). The space of cusp pseudodifferential operators of order m G C is denoted 
ty™. If the symbol a is polynomial in r, rj, the resulting operator is differential, and can 
be written near x = as sums of compositions of partial differentials on iV and of d t = 
—x 2 d x with smooth coefficients on the compactification M. The space of cusp differential 
operators of order m G Z is denoted Diff™. 

Cusp operators are usually presented geometrically in relation to blown-up spaces, which 
might obscure their straightforward definition, so we shall explain this relationship. Setting 
z — (t — t',y — y'), which is a normal coordinate to the set {z = 0} = {t = t',y = y'} = 



(25) 




a{x,y,T,Tj) := a(l/x,y,T,r)) 
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Figure 2. The blown- up manifold M 2 . (We omit the N 2 factor.) 



diagonal in X 2 , we see from (I25p that ka is written as the inverse Fourier transform of 
a symbol using the normal coordinate z. Hence ka is a distribution on X 2 that is, by 
definition, conormal to the diagonal in X 2 . Expressing the kernel (1251) in the compactified 
coordinates, we obtain 



(26) ka = [ e LZ ' iyT ^ a(x, y, r, n) drdn , where z — ( , 

J \x x' 



y-y' 



Note that z is not a normal coordinate to the diagonal (given by {x = x',y = y'}) in M 2 
because the coordinate - — K fails to be smooth at the corner x = x' = 0. Thus, it seems 

x x' 

like switching to compactified coordinates destroys the conormal distribution portrayal of 
pseudodifferential operators. However, we now show how to interpret this kernel as being 
conormal, not in M 2 , but on a related blown-up manifold. The idea is to blow-up the 
singular point x = x' = until the kernel (I26p can be interpreted as conormal. To begin 
this program, we first write 

M 2 [0, 1), x [0, l) x , x N 2 

near the corner {x = x' = 0} as shown pictorially on the left in Figure [2j Next, we 
introduce polar coordinates (r, 9) in the x, x' variables, where r = x 2 + (x') 2 and 9 = 
arctan(x'/x). Geometrically we can think of introducing polar coordinates as "blowing 
up" the set {x = x' = 0} by replacing it with a quarter-circle (the angular 9 coordinate). 
The resulting manifold is called the b-double space M 2 , see the middle picture in Figure El 
Actually, instead of using the standard polar coordinates (r,8), in the sequel it is helpful 
to use the projective coordinates (x, s) where s = x/x', which can be used as coordinates 
instead of (r, 9) for 9 away from and ir/2. Here, x represents the radial coordinate and s 
represents the angular coordinate along the quarter circle. 

Now we form the cusp double space M 2 . To do so, we introduce polar coordinates where 
s = 1 and x = 0, in M 2 , as shown in Figure [2j This blow-up geometrically replaces the 
set s — 1, x = in M 2 with a half circle, which is called the cusp front face and which we 
denote by ff c . Since the set s = 1, x — is the set of points where 1 — s = and x = 0, we 
can use the projective coordinate 

1 - s _ 1 1 

x x x' 
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as an angular coordinate along ff c and we can use x as the radial variable, at least if we 
stay away from the extremities of ff c . Thus, (x, w) can be used as coordinates near the 
blown-up face ff c . Note that the set {x = x'} corresponds to the set {w = 0} in M^, 
therefore w is a normal coordinate to {x = x'}. Moreover, in view of the formula ( 1261) . we 
see that ka is, by definition, a distribution conormal to the set {w = 0,y = y'} in M%, 
which is called the cusp diagonal. In fact, one can prove the following theorem. 

Theorem 16. The Schwartz kernels of cusp pseudodifferential operators are in one-to-one 
correspondence with distributions on that are conormal to the cusp diagonal and vanish 
to infinite order at all boundary hypersurfaces of except the cusp front face where they 
are smooth. 

Our original definition of a cusp pseudodifferential operator as presented after (1251) is 
usually disregarded in favor of the more geometric definition presented in the above the- 
orem. It is evident how to extend the definition from the scalar case to cusp operators 
acting on sections of vector bundles which are of product type in t near t = oo. 

References 

1. M. F. Atiyah, V. K. Patodi, and I. M. Singer, Spectral asymmetry and Ricmannian geometry I, Math. 
Proc. Cambridge Philos. Soc. 77 (1975), 43-69. 

2. M. F. Atiyah, V. K. Patodi. and I. M. Singer, Spectral asymmetry and Ricmannian geometry II, 
Math. Proc. Cambridge Philos. Soc. 78 (1975), 405-432. 

3. M. F. Atiyah, V. K. Patodi, and I. M. Singer, Spectral asymmetry and Ricmannian geometry III, 
Math. Proc. Cambridge Philos. Soc. 79 (1976), 71-99. 

4. C. Bar, The Dirac operator on hyperbolic manifolds of Rnite volume, J. Differential Geom. 54 (2000), 
no. 3, 439-488. 

5. J.-M. Bismut and D. S. Freed, The analysis of elliptic families. II. Dirac operators, eta invariants, and 
the holonomy theorem, Comm. Math. Phys. 107 (1986), no. 1, 103-163. 

6. T. Branson and P. B. Gilkey, Residues of the eta function for an operator of Dirac type, J. Funct. 
Anal. 108 (1992), no. 1, 47-87. 

7. B. Bucicovschi, An extension of the work of V. Guillemin on complex powers and zeta functions of 
elliptic pseudodifferential operators, Proc. Amcr. Math. Soc. 127, (1999), 3081-3090. 

8. S-S. Chern and J. Simons, Characteristic forms and geometric invariants, Ann. Math. 99 (1974), 48-69. 

9. P. B. Gilkey, The residue of the global r) function at the origin, Adv. Math. 40 (1981), 290-307. 

10. P. B. Gilkey Invariance theory, the heat equation, and the Atiyah-Singer index theorem, Second 
Edition, CRC Press, Boca Raton, FL, 1995. 

11. S. Golenia and S. Moroianu, Spectral analysis of magnetic Laplacians on conformally cusp manifolds, 
Ann. H. Poincare 9 (2008), 131-179. 

12. S. Golenia and S. Moroianu, The spectrum of Schrddinger operators and Hodge Laplacians on confor- 
mally cusp manifolds, preprint larXiv:0 705.3559 

13. R. Goodman and N. R. Wallach, Representations and invariants of the classical groups, Encyclopedia 
Math. Appl., vol. 68, Cambridge University Press, Cambridge, 1998. 

14. R. Lauter and S. Moroianu, The index of cusp operators on manifolds with corners, Ann. Global 
Analysis Geom. 21 no. 1 (2002), 31-49. 

15. R. Lauter and S. Moroianu, An index formula on manifolds with hbcred cusp ends, J. Geom. Analysis 
15 (2005), 261-283. 

16. M. Lesch and N. Peyerimhoff, On index formulas for manifolds with metric horns, Comm. Partial 
Differential Equations 23 (1998), 649-684. 



22 



PAUL LOYA, SERGIU MOROIANU, AND JINSUNG PARK 



17. D. D. Long and A. W. Rcid, On the geometric boundaries of hyperbolic 4-manifolds, Gcom. Topol. 
4 (2000), 171-178. 

18. P. Loya, S. Moroianu and J. Park, Adiabatic limit of the Eta invariant over cohnite quotient of 
PSL{2,R), Comp. Math. 144 (2008), 1593-1616. 

19. R. R. Mazzeo and R. B. Melrose, Pscudodifferential operators on manifolds with Gbrcd boundaries, 
Asian J. Math. 2 (1998), no. 4, 833-866. 

20. R. B. Melrose and V. Nistor, Homology of pseudodifferential operators I. Manifolds with boundary, 
preprint |funct-an /9606005 

21. R. J. Miatello, On the Plancherel measure for linear Lie groups of rank one, Manuscripta Math. 29 
(1979), no. 2-4, 249-276. 

22. R. J. Miatello, The Minakshisundaram-Plcijcl coefficients for the vector-valued heat kernel on compact 
locally symmetric spaces of negative curvature, Trans. Amcr. Math. Soc. 260 (1980), no. 1, 1-33. 

23. S. Moroianu, Weyl laws on open manifolds, Math. Annalen 340 (2008), 1-21. 

24. H. Moscovici and R. J. Stanton, Eta invariants of Dirac operators on locally symmetric manifolds, 
Invent. Math. 95 (1989), 629-666. 

25. V. Nistor, On the kernel of the equivariant Dirac operator, Ann. Global Analysis Geom. 17 (1999), 
595-613. 

26. J. Park, Eta invariants and regularized determinants for odd dimensional hyperbolic manifolds with 
cusps, Amer. J. Math. 127 (2005), no. 3, 493-534. 

27. R. S. Strichartz, Analysis of the Laplacian on the complete Ricmannian manifold, J. Funct. Anal. 52 
(1983), no. 1, 48-79. 

28. J. A. Woll, Essential self-adjointness for the Dirac operator and its square, Indiana Univ. Math. J. 22 
(1972/73), 611-640. 

Department of Mathematics, Binghamton University, Binghamton, NY 13902, U.S.A. 
E-mail address: paul@math.binghamton.edu 

Institutul de Matematica al Academiei Romane, P.O. Box 1-764, RO-014700 Bucharest, 
Romania 

E-mail address: moroianu@alum.mit.edu 

School of Mathematics, Korea Institute for Advanced Study, Hoegiro 87, Dongdaemun- 
gu, Seoul 130-722, Korea 

E-mail address: jinsung@kias.re.kr 



